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ABSTRACT 


The theory of optimal control of finite-dimensional 
differential dynamic systems has been extensively developed. 
The application of Pontryagin's Minimum Principle often leaves 
only a two-point boundary-value problem for solution. The 
solution of these problems is an area of expanding concern as 
application of optimal control is attempted. Digital computer 
methods have been developed. In this thesis, the hybrid 
computer is used in solution of these problems. 

A recent hybrid computer technique has been extended 
to a more general target set case: The underlying assumptions 
have been shown to be inapplicable in general, thus limiting 
the class of problems for which the technique is valid. A 
program using the hybrid computer for applying the technique 


to second order systems was written and tested. 


* q ’ 


_ ronr7an 


| Darotanwalb-atielt t6 fetinon Lemigqs to wneeds & 
y > <7 
‘~bagnl evgh yfatienotas nesd and woaseny See 76 
7 ~~ = 
evel testa elryssnls® mortin?™ 2 in paetanet: te fsa 


sat tet lee 191: meldurg ow tv yuna a 


2A nTeoNe: gait ipeg xs $+ Jo-ess. at #f ame) deg, ceeds %. 
vadugmee feted fetes m oe loxtnes {naisqo le 
bhvded ary , ci atris ; ta? At ‘eae “od snd) 

eae! do3q aests Io meolee WE beep ned : a 


bvtgegey nest asdf secintives sa2canres blidiel Qaeees A. 


srudaqunwass Bosvitviinn svt veers. doe opans feyanag stom @ 
BaLitnts Bri? tsseneg ft altrotlqaqnct sd of wore) eae: 

bo oh SES at aupt ast ist an ot ada 1453 tialdeong ie tents = 
Sepimine? of). qnivlqge io ystugras bhedigt aad gntew 


c 


- ‘bezeea3 bor ne: "9 eaw emacs ane tebrd 


e 


ACKNOWLEDGEMENTS 


The author would like to express his appreciation to 
Dr. V. Gourishankar for his encouragement and guidance in pre- 
Parine this work,. to’ Dre Re kimk Lor some, useful discussions 
of the derivations, and to P. Harding for some assistance in 
the hybrid computer work. 

The financial assistance directly provided to the 
author by Calgary Power Ltd., through the G.A. Gaherty Memorial 
Scholarship, and by the estate of Mrs. Dorothy J. Killam, 
through the Izaak Walton Killam Memorial Fellowship is grate- 
fully acknowledged. The financial assistance of the National 
Research Council and of the department is acknowledged in 


supporting the hybrid computer facility used. 


| : _ 
‘ j 4 = i in me Aas “er { — ent s 
aie nets Lee rgd aril BRaay? he NOW Dol Sue Si 
‘ - : 7 
‘5 E ie a i. 
; \ ' ogite wl e577 pe On 1963 sei! ted es Age lei yyo: 


, ' , vt a, A 
nis re 703 92 TL a PAs ans = 
— : tow Jteadue 
} ' ) 7 ) ~ ; IAT ; | 
‘ aie 
le}. ¥ ‘vuppeded LAs f 7 Cot Ey pea vresl =e? | vd tons S 
3 . . A 
mel liy®, .L vbjovot .2ttetn Soni vd ‘bom  witeretolts 


as 


~sinsy et aifevoitel Leltamell rel najleV tdearl san. a8 ra 


Mostlt Jo eaupetztizag Tsinanab? Sit 99> stanton ot 
* ’ 
‘ ~~ a uf 
AL DVSko WONNSE et INSMIAeeSb 1 38) r- (tooped doteeae’l 
| Se a | a na 
‘hee yitiiost yasuqnes blidwt ey gatssegges. 
i] @ 
g a} 
a 
: —— 


TABLE OF CONTENTS 


LIST OF TABLES AND FIGURES 


MAJOR SYMBOLS 


CHAP LER YL: INTRODUCTION 


il eet nesOpEimaie Controle Prob lem 
1.2 Pontryagin's Minimum Principle 
io DOLUtLOneOmerhe Iwo-roint Boundary=— 


Value Problem 
1.4 Scope of the Thesis 


CHAPTER G2. DEVELOPMENT OF THE TECHNIQUE 


2p le introduction 
Fixed Target Sets 


De 2 
2.3 Time-Varying Target Sets 
Hae 


Convergence 


CHAPTER 3: METHOD OF SOLUTION 


Bele Introduction 


Lo W Ww 
ePwhN 


CHAPTER 4: APPLICATIONS 


dot Sbele siewantemale OceniUieysere 


4,2 A Bilinear System 
iS cCus SuOnmOlmm estes 


CHAPTER 5: COMMENTS AND CONCLUSIONS 


5.1 Improvements in the Program 


5.2 Summary 


5.3 Suggestions for Future Work 


BIBLIOGRAPHY 


APPENDIX 1: SOME DEFINITIONS AND RESULTS IN OPTIMAL 


CONTROL THEORY 


APPENDIX 2: SOME SASEECIS@OESHYBRID COMPUTAT DON 


APPENDIX 3: DESCRIPTION OF THE HYBRID COMPUTER 


APPENDIX 4: THE PROGRAM 


Organization of the Program 
Description of the Digital Program 
Extensions of the Program 


68 


ye 


? 


mot ri) 7 F VOTTHISnewT 


i 
- 7 
7 


¥/1 7 a fo AT as 


<o 
e 
" 
25% 
' ia 
i" if mo ? } 
i mem lit i 
" fy , #4 } 
fal 
J b} 
i. 
7 ‘ 4 sT7% 
; f 2$ ge MAD 
| yy 
Mm a 
> 
1 - si i - 
he | } ma an 
ide: 1G Gow rar :€ ASTSARD 
7 > 
pin ta. ehe p, 9 _ _ 
i] 
‘ ’ E 4 [. -F 
ul i 
’ & 
4 cc 
j wr. o 
tt ie 
{ 4 srt) ra 
, : : oy: id 
é ‘a A 
t«< ' A e « 
7 t j 2 
4 7%. 
4 -e 
— 


“- 
THLARIOL IETS: 
7 - 


arf 
j i) i c zs i] — * 
~ * e 
f 5 i0 3 Le ») 
7 
} t J Jat . 3 
7 


: MAROON Bey " : sra0 
as 


_ 
a 


re 


iu 
. 


Symbols 


U 
x 
Superscripts 


(o) 


* 


(vi) 


MAJOR SYMBOLS 


Cost 

Difference between target set and state 
Terminal error 

State derivative 

Target set 

Hamiltonian function 

Cost functional 

Positive constant 

Control space dimension 
State space dimension 
Costate 

Reachable set 

Time 

Terminal time 

Controls funerion 
Admissible set of controls 


State 


inttialequanti cy: 
Optimal. quantity 
Arbitrary quantity 
Transpose 

Time derivative 
Closure of a set 


Augmented quantity 


ete WOU 


. a ae 


\ ! ice 
TOTIS f 
art t: 


wt 4 
ae t 
a) , 
-J 
a 
' S 
- 
| 
i j * 
J i | 
' 
pti 
' ‘ és 
5 


ase 8 20 axune 
» Ww z : 
U5 hd they f has bealiLer 


Subscripts 


Initial quantity 
Final quantity 
Terminal quantity 
Coordinate 


WEC@EOIe Ole MeIETesIS< 


(vii) 


otf ; ; = 
-_ sioneup LAER 

_ | . : 

vjiinbop Fenty 


; : yJI2 I np tes tarot 


FIGURE 


FIGURE 


FIGURE 


FIGURE 


FIGURE 


FIGURE 


FIGURE 


FIGURE 


FIGURE 


FIGURE 


FIGURE 


FIGURE 


FIGURE 


FIGURE 


FIGURE 


AA 


LIST OF FIGURES AND TABLES 


BLOCK DIAGRAM OF THE SYSTEM 


SOME DISTANCE NOTIONS IN E 


TANGENT HYPERPLANES IN EB? 
ATTRACTION FUNCTIONS IN STATE SPACE 

EXAMPLE 1: HYPERSPHERICAL TARGET SET 

EXAMPLE 2: INFINITE HYPERCYLINDRICAL TARGET SET 


EXAMPLE 2: INFINITE HYPERCYLINDRICAL TARGET SET 
IN TRANSFORMED STATE SPACE 


EXAMPLE 3: HYPERCYLINDRICAL TARGET SET WITH 
HYPERHEMISPHERICAL ENDS 


THE SEARCH LOGIC 


REACHABLE SETS FOR EXAMPLE (RIGHT MOST 
BOUNDARIES SHOWN) 


TYPICAL HARMONIC OSCILLATOR SOLUTION 
INPUT AND OUTPUT FOR FIGURE 4.2 
TYPICAL BILINEAR SYSTEM SOLUTION 
INPUT AND OUTPUT FOR FIGURE 4.3 


PROGRAM FLOW CHART 


GALES) 


ZA 


26 


30 


Al 
42 
47 
48 


85 


: 
{ 
~ 
a 
= 
e/ 
x 


~ 


Lo 


j~ 


t 


Oo "9 
LG 
4 ; T 
,ele t. 
) 
ier 
- 
: 
« 
— 


or JASINUNTIZIROVTH TTIMTTL «1 at.S 


7 sxe amias : rh] ; ~ 7 at ™ resi y 

al 74 ; I + 7) eH ‘a =~! OT a 

‘ bi ; J 
; r wi 

' 

. 
=, r ~~ =% 4 
rie ] ry iJ | 
a wy 
a4 8 10k 
t \ = . 

iit i A\.2 ri 
4 hy a ¢ 
; ! y F 
- rica 
te ‘Vs 

£ e } } " 
z j I | dA £ 
' + aT oT 
; ) cee Bs 

4 3 e * 

li ae | busayy 


1 7 a 
7 7 
—_ 
; - ° 
BANAT GLA PSAUSI4Y 
' MTS) r ] 
“a AY nr Te 
ey 2A TRAST 
SDAS2 ATATE Mi 2KOLTORNY wa 


182. VENA IWOTASNTeHTS «Fe SARS s.¢ 


E,) 38097) AG) T3390 oeA Tat | A 
. a 


i.a-A BUST 
< 


CHAPTER I 


INTRODUCTION 


Pei the Optimal Control Problem 

In recent years, several approaches have been developed 
for the automatic control of physical systems in an optimal manner. 
A hybrid computer technique for some optimal control problems is 
presented in this thesis. The systems to which this technique is 
applicable fall in the class of finite-dimensional continuous-time 
differential dynamical ayetene ee 
It is assumed that the systems can be simulated on an analog 
computer. 

The statement of the optimal control problem used in this 
thesis follows. The plant or process is represented by a vector- 
matrix differential equation called the state equation 

a 2 es aye (1. 
The block diagram of Figure 1.1 represents the system. 

The problem is defined over some connected interval of 
time. [Lo owaith 

tacel | Gk 

iiemstate, x(t) ,etepresents, the changing characteristics 
of the system; given by the solution to (1.1). With BE" taken as 
Euclidean n-space, 

(ie) @ Fn. Ge 
No other constuaints are. placed on x(t).. 


“— Numberesines@udie sbrackets refer to the literature cited in the 
Bibliography. 


See Appendix 1 for definitions. 
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FIGURE I.| BLOCK DIAGRAM OF THE SYSTEM 


Hiegcont: ol lunechLonn mile) pebep resents the input to uthe 
system by which the output is determined. 

Ga) G Ween ee Ce 
fe is assumed that u(t) is not subject to any state-dependent con- 
straints. 

The index of performance or cost functional of the system 
is taken to be the integral of some scalar function of the states, 


controls and time. 


t 
Ge = f(x, iy Disha Cie 
E 
(0) 
where 
ilies 
Dron t., Cl cle. . ( 


Mhe state of the system is initially given by 

O 
x(t.) = 2°te,). eh, 
The final state is required to be 


x(t,) ohelEAl@as Beals | CE? 
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where 

© Ge, Wipe Ae) Be hes 8) (89) 

The optimal control problem involves the determination of 
the optimal control u*(t) from among the class of admissible controls 
eivensoy aw) ewnteMe Eraneters tne etateex(t)eof (1.1) Lrom othe anitial 
state (1.7) to the target set (1.8) with the minimum value of cost 
ito). 
1.2 Pontryagin's Minimum Principle 

The use of Pontryagin's minimum principle is one of several 
possible approaches to solution of the problem posed in the previous 
section. The use of this principle yields the necessary conditions 
which an optimal control function must icc These conditions 
are also sufficient conditions for all extremal controls. Several 
excellent textbooks containing a detailed derivation of these condi- 
Etonsedresavallable.© Somer obr these are noted in the bulsekceeecrtrg ee 
It is assumed in this thesis that the minimum principle can be applied 
to the systems studied. 

The relevant parts of the necessary conditions are briefly 
stated here. 

Define the costate vector, p(t), a form of Lagrange multi- 
plier; 

mde )ide SEA (1.10) 

Augment the costate vector with p(t). 
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4 ak 
p(t) = (pi(t), p(t))" e E 
where (yn means the transpose. 


Augment the state vector with J, by letting 


x(t) AG <9 x(t) = 0 Gime) 
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SeCUo CaaS (x et) = f(x, u,_t) 
iL 
me out Te Se et) (1.13) 
Define the Hamiltonian function as 
MOSS Uy Jay Mn oF ek tgs (1.14) 
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To specify p(t), we define 
p(t) =-—=. (1.16) 


One of the necessary conditions required by the minimum 
principle is that the Hamiltonian for an extremal control be 
HIinimMuMew Men Gespectytorall ‘other controls.’ That) is, for u*(t) an 
extremal control 

Hiceeeu Set Sips Seal (x Aen een) CO 
This condition will ordinarily determine the extremal controls as a 
fmctton-of ithe states wand. costates, found by solvine @.15) and (1.16). 

ice) et ees he (lai) 

Using these necessary conditions, extremal trajectories can 
be generated. The problem is reduced to what is termed the two-point 
boundary-value problem, finding the correct initial conditions for 
the state and costate which bring the extremal trajectory to the 
specified final conditions. An extremal trajectory thus found may 
then be tested for optimality. 
tao Wselution of the sTwo-Point Boundary—-Value, Problem 

It is clear from the previous section that the solution of 
the two-point boundary-value problem is essential for the applica- 


tion of the minimum principle. Several methods have been proposed 
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for solving the two-point boundary-value problem. 
For the simplest of problems, analytical solutions may be 


fOounGas. “Athans and ralp ltl 


develop these techniques for a few systems. 

In most cases, however, some form of iterative procedure must be used. 
One strategy would be to guess a set of unknown initial 

er aterone: solve the system of differential equations for those 

COnNdITe1ONs, and correct Che imitialvconditions so as to better match 

Eice lina eeonditions. (hus, ,etiis strareey 1s a parameter search on 


thevmissing initial conditionsicarried out by the iterative solution 


Of va Setsor initial conditien problems, “Many other strategies exist, 


[3] 


and there are many ways of implementing each. Bekey and Karplus . 
Balakrishnan and Naweraqeeces and Ror dod aad provide starting points 


for literature surveys. The strategy described here is widely used 
and will be used in this thesis in a modified form. 

Solution may be attempted by pure analog methods, with human 
decision-making. Using repetitive operation, trial and error searches 
are feasible on up to third order systems, at least. Some of the 


hea 


articles in McLeod examine analog methods applied to two-point 
boundary-value problems. Analog computation is severely disadvantaged 
by the inability of analog computation to handle anything but the 
simplest logical decisions. 

The usual tool for solving two-point boundary-value problems 
is the digital computer. One of many possible sources, Balakrishnan 
and move canteee gives a survey of the application of a number of 
techniques. 


Some general concepts of digital computer solution of two- 


point boundary-value problems using the general strategy described 
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are presented here. 

The accuracy of digital computer solutions can be very high. 
In cases where the accuracy requirements on the solution are higher 
than the .1%4 to 1% possible with modern analog computers, there is no 
alternative to using a digital computer. Such requirements arise, 
for example, in satellite trajectory computations. Often, however, 
the accuracy is a by-product of the necessity for preventing accumulated 
round-off errors from destroying all accuracy of a digital computer 
solution, and is not required (or usable) in many engineering applica- 
tions. Appendix 2 expands these concepts. 

In terms of computer utilization, digital computer solutions 
are often expensive in that they take a large amount of storage and 
much computation time. Specifically, a fast computer with a large 
amount of storage is required if a problem is to be solved quickly in 
realatime., Solution on a “small digital computer will in, general be 
slow in real time and in some cases may be impossible because of lack 
of storage capability. This situation is caused by two factors in 
the solution of differential equations by the use of a digital computer. 
The system must be solved as a set of difference equations, which means 
that a large number of calculations must be carried out to high accuracy 
in order to assure an accurate solution and to avoid cumulative round- 
off and systematic errors which may otherwise occur. Each calculation 
by a digital computer must be accomplished serially, increasing solution 
time with system complexity. Use of the analog computer for solution 
of differential equations does not have these disadvantages. 

Hybrid computation has the advantage that the best points of 


analog and digital computation can, be used. The speed of a high speed 
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analog computer can be used for the solution of the differential equa- 
tion system. The logical, storage and calculation capabilities of the 
digital computer can be. used for implementation of automatic iteration 
schemes. The accuracy possible is limited by the analog solution. 
Further features of hybrid computation are discussed in Appendix 2. 
In many ane ioeerine Situations, a fast and inexpensive solution tool 
is available to do a job which could be done equally well only by a 
much more expensive digital computer. 
if4eeSeoapesor the Thesis 

A computer program for the solution of some optimal control 
problems is presented. Pontryagin's minimum principle is used to 
determine a two-point boundary-value problem. A hybrid computer 
available in the Electrical Engineering Department is used to show 
that the computational technique is fast compared to some digital 
computer techniques. Appendix 3 gives a brief description of the 
hybrid computer used. 

The technique presented here was inspired by a paper by 


at Wie shod a sated. Tear oe 


The authors presented their 
approach for point target sets at the origin. They have given no 
details of their computational methods. 

This thesis presents a derivation of an extension of their 
work, an improvement in technique of application of the derived condi- 
tions, and a limitation of the class of problems for which the tech- 
nique is applicable. 

The derivation is extended to the case of general fixed tar- 


get sets, with the method of attack for time-varying target sets in- 


dicated but not derived. The algorithm derived by Miura et al turns 
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out to be a special case of the general algorithm. 

The technique of application is improved by the use of high 
speed analog computer techniques to quickly solve the differential 
equations; by fast digital computation and control by the use of a 
low-level assembler language; and by the use of a steepest descent 
search scheme to bring rapid conve reen cee 

The class of problems for which the technique converges to 
the optimal solution is restricted and it is shown that the derivation 
in Miura et gills is incorrect as given. 

The derivation of the algorithm is given in Chapter 2. The 
method of solution and the hybrid computer program are discussed in 
Chapter 3. The application of the technique to two second order 
systems is discussed in Chapter 4. The fifth and last chapter of the 


thesis consists of a discussion of the results and suggestions for 


future work. Four appendices are provided for related reference. 
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CHAPTER 2 


DEVELOPMENT OF THE TECHNIQUE 


2.1) Introduction 

The technique used to reach the optimal control solution is 
described sinethic chapter. [his technique is basically a method ‘of 
solving the two-point boundary-value problem which results when 
Pontryagin's minimum principle is applied to the control problem. 
The conditions for convergence of this technique are examined. Both 
fixed and time-varying target sets are considered. A detailed deriva- 
tion is included for the case of fixed target sets, whereas no deriva- 
tion is given for the technique applied to the time-varying case. 
2.2 Fixed Target Sets 

For each of a monotonically increasing set of costs, the 
terminal state is brought as close as possible to the target set. 
This process is terminated when the terminal state is sufficiently 
close to or at the target set. The value of initial costate which 
brings this solution is defined as the solution of the two-point 
boundary-value problem. 
Statement of the Problem 

Given) the dynamicalesystem of (1.13) with 

f= ee ty (2.1) 
WitieiniisoLal Stace 

I(t) (2.2) 

O 

and final state in the target set given by (1.9) 
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and controls 
a A 4 
ACC) anv. (x, op) (2.4) 
from (1.18), find the set of initial conditions, n*, of the costate 
equation (1.16) 


p(t) = 5-3 (25) 


Suene ciate cel) (22 eee (2 oe 4 end (2, >Jware all simultaneously 
satisfied. The solution vector, nt, is the solution of the two-point 
boundary-value problem. 

Hteiceassumeds that theresexists a solution m* which’ solves 


the problem in a finite time, t,*, and with a finite minimum cost, C*. 


ik 
Before proceeding with the derivation of the technique, a 


few definitions will be given. 


The Banach Space at 


= 2&5 n 
With the Euclidean norm, ||x|| = ( 2 |x, | ey sees aes 
i=l 
and the norm-derived metric p(x, y) = js yl |; ye Eee 
: : : Tae (| 
@ being the distance function; the space E is a Banach space : 


iMacGeie,sit tsea normea (thussmetric), linear, and complete space of 
vectors. 
Distance: or a vector from a set 


ierdis lancer rOnea VECLOL ex LOsayser Gis deiriaed as 


DC meeveomint o(x,.y) « 
yeG 


WEACIEOGIC Tice, 2 WeCE@r co) 2) SCE 
The vectors from a vector x to a set G are 
GPoax = ly = x | o(x, y) = ox, Os 72 ee which may not be unique 


but which have unique length. These last two concepts are illustrated 
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p (x, 5G) = o(% oY) = p(x sy") 


FIGURE 2.1 SOME DISTANCE NOTIONS IN E2 


the reachable set, called R(C), is defined as the set of all states 


which may be reached from Ae 


—- 


(t,) in cost C using the extremal control 
strategy. in symbolic notation, this’ can be stated as 
Me) | GG) (ey a 8 a Se as Se 
fae) (Ze) Ia eh (eae (Ope ier lel BPs (C2 60) 
Clearly R(C)MG (x) #4 if and Gallyei tes tC. 
Consider R(C) {1G (x) # ¢, which implies that there exists a vector, 
Zeb) ,ecuch that 2(L)ee Rn (C)eandez(1)j<G (x). But then (2.3) as 
satisfied as well as the others given in (2.6), the definition of 
R(C), and the problem is solved. Thus C = C* since this is the minimum 
extremlesolucion. — lhe reverse case is obvious. Thus R(G)VW)G (x) is 
nonempty first at C = C*. The approach used is based on this observa- 
tLon, 


Derivation of the Method 


The underlying principle of the method is outlined here. 
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Beginning with a cost of zero and using an increasing set of costs, 
the terminal state (in the reachable set) is kept as close as poss- 
rove eo the; tanget set. # lt, thissecondition is maintained from C = 0 
untuly Gps .G*, sthen the anitial costate corresponding fo the last 
iteration which had C = C* and which brought the terminal state to 
the target set is the one which produces the optimal control, be- 
cause R(C*) f)\ C(x) = x(t) and BeguoauLoncm (ze) sbO m2.) uateua LA 
satisfied. 
Formulation of an Equivalent Problem 

Consider operating the system* with a particular cost C and 
anginttiralicostatesn, |lhe terminal stateseand scostates can be .con- 
sidered to be functions of the parameter C and the vector parameter 
Lie Since fixing these values and operating the system must give a 
unique result. The terminal state and costate are thus written as 
Ea (C, n) and ioe (Cio0)onboimee G(x) ieearsetein ge") Aadenentiont of 
G and n, G can be written for eo): Then the vector G(x) = 240Gy ) 
CanmbeawrretcensG —=x(Grm) = D( Coen) gi Of course, 
Wncore) ead Gee x(Cs mm) sO eror c= ce. 

Thea problemato be solved is that or iinding the correct 


value Ob initial costabe for) anyecost C.) Consider any value of n, 


+ + + 
say n. AL ae JP =sCeancsg0e = 2 0(Ce pn J. D is a fixed vector in 
oe The new objective is to minimize the cost functional 

1 ata 
a way) Wey (2.7) 


* The phrase “operating the system'' is taken to mean the following. 
Foreareivyen problem, assign a value Lorn, the initial costate and 
solve the system equations until the cost is C. The time at which 
this occurs is called the terminal time, T. The state and costate 
are the terminal state and costate, x(T) amd (0), respectively. 
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where the “inner product used ts'(a, b)= a Os Ziky lene? Be 


Maece iS ge lease Oneey.] G suche tar 


G-x(C,n) = y-x(C,n) = D(C, n). (2.8) 
These values of y (if not unique) are functions of the state x, and 
all give rise to the same value of ED les 
Constraints 

Thereware two possible characteristics of G for any y. 
The tangent plane may be unique, in which case D(C, n) is normal 
to all vectors in this tangent plane. The tangent plane to G may 
Notmestot@al sy weal which Case. 1fone considers a hypersphere 
around y, D(C, n) can be considered as normal to the hypersphere for 
any non-zero radius. It will be a computational necessity to have 
-a small tolerance around such a point, thus the use of a tangent 
plane to a hypersphere around the point is a useful concept. Figure 


Dees wiiustrates. fheseiconceptsf in a 
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Restrictions are placed on the state space and the target set. 
In general the cost is unconstrained so that 

G(x) = G(x) . Oe) 
It is assumed that the space EB is separated into two sets 


G and H = G (= {x]xeE™ and x¢G). H 


eat? with each qe being 


enaracteqized by a specitic yalue of x and a constant Ke and with 


a a set of andices, quite possibly mondenumerable. For x ¢ H , 


a 
(ax) 
Dieiiewere (ie aaa eal) 
a eae 
When ee Ha Ho (2a) 
(x - x 
_ pad ec. L 
is LS 2G (| [x a ele Eee 
== eink 
(x - x 
: mm tae OZ 
ey ee ities cepa im te (2.12) 
ee Sas 
This form of D means that the following equality holds. 
eS Be Ay ate 
| Dl = a8) a 


x, can be considered to be the "attracting point" for D corresponding 
to each x. 
In order to analyse the system on a computer, the sets H, 


must be grouped into a finite collection H Bee Oo wach UAH = 


B’ BEB B 
oRae = ¢° The unifying feature of each He is the function which 
determines the set of attracting points x PO Le caal: ale € He: For example, 
Lomaesce We x form a line segment, then ihe would be the domain of state 


Space using that line segment as a set of attracting points, and the 


line segment (and thus each x) would be given by a particular function 
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Onn One x. 2 He: These concepts are demonstrated in the following 
excamplessand in Micures 273 to 2.6. 


Examples 


1. Hyperspheres - Figure 2.4 


eee od ur re dees Sate pe oy (2.14) 


Sg) 

ipseeme Aiea ea cays teres. (2.15) 
emacs ton : 

In the framework of the derivation, only one region of 


H = G° need be considered, with 


Oa oe eG? Sai Ke = R (2716) 


Porsagscing lec and Bf x € Hy = He Vx eGo. 


The work of Miura, et am 


is concerned with a special 
case of this example. The technique is derived there for the target 
set being the origin of state space. In their paper, then, they have 
used go aeOmondelw= =) oOetia te) sex veiteresult is 

WG) = = FedGo) Qs17) 


WUC sce came as e¢iventby (2235) in this case, 
Pr(C, n) = — kx(C, n). Cys) 
Jemeiicinvee uypercy Linders —siigure 2.5 
eiesi ec lednie 2) 8 8) 2) By 2 BE: 
One Go). (2219) 
a line in state space through 8) and Bo: 


6 = {g) |\e= &, | | Suh ee ue Eye (2520) 


Here ih ee fl Ge - By) = for 


| 
“™~ 
* 
| 
R 
we 
a9 
22 
m 
gq 
~~ 


* 
(op) 
=e) 
cw 


ya (mtn SOE oS C21) 


? 
~'f 
i 
. 4 
e 4 
: 
A 
% a 
aia * } 
% 
as 
7 


; 
7 Ay 
fi 
« a 
2 ae eo oO ap 
he i ~~ 
a 
. 


kite 
TaCyt). So beige 
er 


16 


a a ae Ti Sg pore 


[7 X37 Xa X7 are points 
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ATTRACTION FUNCTIONS IN STATE SPACE 
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FIGURE 2.4. EXAMPLE I: HYPERSPHERICAL TARGET SET 
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FIGURE 2.5a EXAMPLE 2: INFINITE HYPERCYLINDRICAL TARGET SET 
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FIGURE 2rob) EXAMPLE 2: INFINITE RY PERCY LINDRICAL TARGET 
SET IN TRANSFORMED STATE SPACE 
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Bar Pi Oe 


H, = Cane ae (-~, ~) 
Xe is the set of points forming By 
kee= RR Vfor atsangle 6 Cres) 
Here again only one region need be considered with By being 
the attracting function (representing a set of attracting points). 
Computational considerations indicate that an effective 
method for treating this type of target set would be by transformation 
of the system equations by the linear transformation matrix A with 


unity norm which takes the set So Imtoudelinesine (say). the xy direction. 


are C3 gen he: Co to 


care rea lecons canes a. (Qe) 


Assuming that the system equations have been so transformed, 


mognave wea(X) =SGoRe Cisne. Bs ¢)) (2.24) 
and 

Des nes ar Cla@® - xlI-®. (2.25) 
Netemenatea( <)e— x)= (0), Gye Spo Goe 833 ge cS ) (2776) 


Thissmakes the caleulataon of D convenient in practice. 


3. Hypercylinders with Hyperhemispherical Ends - Figure 2.6 


Th 
g, = {gle = og, + (1 - a) gys By, Bp» Be Es cel0,1]}(2.27) 


a line segment in state space from g, tO £- 
n 
© Sos ea) Soke aes (2.28) 
Consider a transformation A as in the previous example. Then 


Bao A ge = (CO Pe eC som case Ch) 
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FIGURE 2.6 


EXAMPLE 3: HYPERCYLINDRICAL TARGET SET WITH 
HY PERHEMISPHERICAL ENDS 
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In this case there are three regions of state space with 
different attracting functions. 
The Terminal Condition 

The purpose of the preceding discussion has been to develop 
arguments for the terminal condition, the requirement which ensures 
tate thes costwhunctionaled sof a2. /) Hs minimizedia, leiiserequired 
that D(C, n) be brought as far as possible in the direction a One 
of the necessary conditions is the transversality condition, that the 
costate vector be normal to the tangent plane to the target set. The 
consideration of an infinitesimal hypersphere around a point at which 
the tangent plane does not exist extends the transversality condition 
to such points, within tolerances imposed by computational considera- 
tions. 

Suppose De isjchosensto make J' minimum. Then, for all 


possible. D eek (DexaD Denk (DAs D) (2).188) 
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or a ese | Ota (2.34) 
Thus D* is the vector to the Palteetecct: tesultinestrom ithe, cerminal 
* 

state Xp (GC) closest "to-the target set: 

Thesrequirementatorgiinding D™ is that J’ be minimized. 
From the transversality condition a necessary condition for this is 

By (Crene= DC Ch t) (2.35) 
since D(C, n) is normal to the tangent plane to the target set or to 
the infinitesimal hypersphere around appropriate points of the target 
set. (2:35) is called the terminal condition in this thesis. 
Application of the Terminal Condition 

The extremal control generated by the terminal condition is 
found in the following manner. At cost C = 0, the value for n = kD 
Lemascsiened, which Satisiies (2.35) since © = 0 implies t= 0. A 
new cost is formed by incrementing the cost by AC. Beginning with 
the value of 7 from the previous step, a new value is found which 
satisfies (2.35). This process is repeated until the terminal state 
is close enough to the target set. In this manner, the terminal state 
at each cost C has been brought as close as possible to the target set. 
For the case where the reachable set is convex and for the case where 
the local minimum of J' which first appears eventually leads to the 
optimal solution, this strategy will find the optimal solution. These 
considerations will be discussed later in this chapter in section 2.4. 

The search strategy by which the correct value of n is found 
at each cost C consists of a steepest descent search applied to the 
minimization of a terminal error norm. 

The error norm used is of the following form. The terminal 


Condition required that (2.35) is satisfied. This will be so if and 
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Thus, the vector E(C, n) defined by 


= = Di(Graen) 
E(C, nh) Te. IT 7 Thc, wT] (On87) 


represents the error in direction of Pr: The norm Orme (C, 1) is 

used as the terminal error norm. 

The search strategy consists of five steps. Two tests are 

Made at var1o0us steps. Each time =the system is operated, nea is 

booted eal iereelse less tianetie erste tOlebance the search for) is 

ended. Hach time ||E|| is calculated, it is tested. If it is less 
than the error tolerance, the terminal condition is considered met 
and the cost C is increased by the increment AC. The search goes 

Dac CO@aLeD al. 

1. The previous successful value of n is used as a starting value and 
Biewcyccemeismopecdted svOretiegiarstestep,, )-akDeis used: 

2. The system is operated n times with steps An in each of the 
(Cartesian) coordinates of n. 

3. From these n + 1 values of the terminal error norm, the negative 
of the gradient of the terminal error norm, -V|lEl|, is found, as 
ae cerocdeimapproximationw | lhisels the direction of steepest 
descent of ||E||. 

4. The value n is modified by the addition of the term (-V||E|])An 
and the system is operated. 

j.eeotepy4 Ls repeated until | |e] | no longer improves. When this 


occurs, step 4 is reversed by subtraction of the correction term 
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to give the last value of n which improved Leys Then the search 


returns Co sstep |: 


The flow chart in Figure 2.7 shows the search logic. 


2.3  lime-Varying Target (Sets 

The natural extension of the preceding section is to a time- 
varying target set, using the terminal time T each time the system is 
operated as the time for defining the target set in finding a value 
for D. That is, if the target set is a time-varying set, G(t), then 
when the system has been operated 

DCCy a= 9 CE) E-e(Coon) (2.38) 
Used in this manner, the correct final time is an additional parameter 
dependent on determination of the extremal solution. The same argu- 
ments hold as in the previous section. In particular, at the closest 
approach of R(C) to the target set, there would exist a D(C, n) which 
Minin zese) trom (2, /). the applications of (2.35) would tind the 
waluewor Uetor each C. 

A second approach is possible. The final time is predicted 
and called T. and G(T.) ismused as sthestargetgset.. “Ihen qT, is modified 
ijecieetterations along with Cor n. D) could (be treated fasya. tunction 
of Tes so that a new value of T . would be found using | |p| | = 0 and an 
interpolation scheme. Substantial programming effort would probably 


be necessary to ensure an orderly automatic solution attempt. 


2.4 Convergence 


There are two important considerationsin the convergence of 
the technique presented. The conditions affecting the convergence to 
an extremal solution are discussed, as well as the conditions under 


which the solution found is optimal. 
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FIGURE 2.7 THE SEARCH LOGIC 
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It is not possible to exactly specify the requirements which 
would guarantee convergence to an extremal solution. As in all discrete- 
Step methods of solving continuous problems, step size of the various 
incremented quantities can be of fundamental importance. The sensitivity 
of the final state to the initial costate often becomes eceab, requiring 
larger error tolerances in terminal matching and final state conditions. 
Qualitatively, it is possible to say that this method guarantees conver- 
gence in the limit as step sizes become small enough and if the costates 
are continuous functions of time. The latter condition, along with the 
continuity of the cost guarantees a continuous variation of initial co- 
State with respect to cost. This ensures that the new initial costate 
will be close to the old one, for small enough changes in the cost. This 
heuristic argument is intended only as an explanation for the convergence 
of the method which has ‘been observed. 

In order to facilitate convergence the following procedure is 
used. Initially, rather large erence steps are used for the search. 
When the terminal state is brought to within the initial error specified 
for the target set, the size of the steps used is reduced. The solu- 
tion is then continued from that point with smaller steps, allowing close 
approach of the terminal state to the target set. This approach, often 
called "getting into the ball park", has been found to give rapid con- 
vergence in real time as applied. 

This rapid convergence feature gives this method an advantage 
over pure analog and pure digital solutions. Pure analog solutions 
cannot be automatically implemented. Pure digital methods, following 
the strategy of a Pere search on the missing initial conditions 
as introduced previously, often require initial trial values close to 


the final solution in order to guarantee convergence without an 
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inordinate number of iterations, which are costly in real time and 
capacity. The method proposed here uses the ease of solving differ- 


ential equations to advantage in order to ensure convergence to an 


extremal solution. 

The conditions under which the extremal solution found 
by this method is the optimal solution have been investigated. Con- 
sider a convex target set. When the reachable set R(C) is convex, 
convergence is guaranteed to the optimal solution. This condition 
is not usually satisfied. When the reachable set is not convex, 


there may appear, for costs greater than some cost C more than one 


‘faa 


peimuninen(C)aC enC which are localiminimaof Jj. © lhat@as, there 


iz 


may be multiple points for which J' is locally minimum. The method 


proposed here will find one of them, usually the one for which 


aliait Ic is most negative. This method searches for the extremal 
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solution which most rapidly approaches the target set at the cost where 


two or more local minima of J' come into existence in R(C). This point 


will be further clarified by means of an example. 
Example 


Consider the system given by the following specifications. 


1 -10 0) 
x = hue = CaP (9639) 
a u OF : 0 
umes tole, 1] (2.40) 
te 
J = C(x,) dt (2.41) 
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Examination of the system shows that the optimal solution 
strategy consists of the control sequence {-1; 0; 1} switching at 
times (6551.5; 8.5} and with eost 30.7. A second extremal trajec= 
tory is caused by the control sequence {1; 0; -1} switching at times 
LU mol witiecost 60. Alletrajtectories remaining ain the rezion 
Sid is) aS Xo < 1.0 are extremal with cost 100. The method presented 
here would, under near-perfect convergence, maintain the initial 
veltienore ne chosen mtil C=l005 "since the initial yvaltie or 1) satisties 
enesterminal condition for all costs from Oeto 100. Lf the program; 
Dyeadcitteorenotee, should findethe brapch of RCC) at Xo» = iM Opartes 
eost €=1070;, itjwouldsattempt) to) continue with that. branch until 
C=60. This would then be indicated as the solution. A rather advantag- 
eous set of errors in the program would be required to find the 
optimal branch of the reachable set. See Figure 2.8. 

This example shows that the method may give quite mis- 
leading results. Further work would be desirable in clarifying 


the conditions causing failure of the method to find the optimal 


solution. 
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CHAPTER 3 


METHOD OF SOLUTION 


Dele lotr oqcuct don 

In this chapter, the technique developed in Chapter 2 is 
applied to second order optimal control Problems. | The wioeic) and 
organization of the program is described. Performance, improvements 
and extensions of the program are examined. In connection with this 
chapter, the last three appendices contain supplementary information. 
The techniques of hybrid computation as applied to this thesis are 
discussed in Appendix 2. Appendix 3 describes the hybrid computer 
used, an EAI TR-48 with a DEC PDP-8, in the Electrical Engineering 
Department at the University of Alberta. The program flow charts and 
the program listing. assembled by PAL-D form the fourth appendix. 
ge UO eeanization lof the’ Program 
Implementation of the Solution Technique 

Use of the technique developed in solution of the two-point 
boundary-value problem involves a basic change in search strategy 
from the direct parameter search. In the parameter search for the 
satisfactory unknown initial conditions, the extremal control strategy 


is implemented while reducing an error norm, the distance from the 


Sh 


terminal state to the target set. The problem can be highly complicated 


by the lack of a final time, which causes complications in the detection 


of run-end conditions. In the method presented here, the magnitude of 
the search problem is reduced, and run-end conditions are very simple 


to Handle. The minimization of terminal error at the projected final 
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time is replaced by the minimization of error in satisfying the term- 
inal direction conditions on the terminal state and costate. At the 
conclusion of the search, an extremal solution to the optimal control 
problem is found. 

The terminal direction condition, (2.35), is equivalent to the 


following set of conditions in the second order case. 


na pe 
The, IT = - TIT or Py =- DI (i!) 


and 


2 2 . De (3.2) 
Ore wip ahs 5 
Po || Doe 2 2 
! 
where Py and Bly indicate the normalized quantities as shown. The 


ccuminalwerror normeusedsis that ot (2.07) 

ND = ((p, +D,)” + (py + D,))%. (3.3) 
The program attempts to bring ND to less than ER, the initially 
specified terminal error tolerance. 

The search scheme devised is a type of steepest descent 
technique using the gradient of ND at a nominal initial costate. The 
nominal costate vector is successively perturbed in each component 
and the approximate gradient calculated from the corresponding values 
of ND. Then steps are made in the nominal costate vector in the 
negative gradient direction until no further improvement in ND occurs. 
The calculation of the gradient is then repeated and further steps 
in the initial costate are taken. The search ends when the value of 
MUga@eanvy step 1s less than the terminal error tolerance, ER. Then 
the cost is increased and the search for the correct initial costate 


is repeated. 
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The search for the extremal solution to the original problem 
is thus occurring as the cost is increased. It was established in 
Chapter 2 that continuously satisfying the terminal condition would 
bring the terminal state to the target set when the cost reached the 
- minimum cost or some other extremal cost. When the state error norm 


2 Bots 
= 3 
Re Or eeeeD oe) 


Gas) 
is found to be less than EX, the state error tolerance, the problem 

is considered to be solved and the solution is printed out. 

Task Assignment in the Seascale 

Use of a hybrid computer allows a choice in the manner of 
execution of the various component tasks which make up the solution 
of the problem. In this section, brief explanation of the task assign- 
mentis given. 

Input of the problem data is done by means of the digital 
computer, programmed to read the teletype keyboard. This allows con- 
venient input to the program with a printed record made. 

Using input data or iteration search logic and calculations, 
the digital computer sets the initial conditions for a trial solution 
run. 

The eee computer solves the system state and costate equa- 
EPtonomeinesoO doing, Lt calculates the extremal control and the cost, 
halting the computer run when the cost exceeds the specified terminal 
COSL. 

The digital computer Ws used for storage of the terminal 


results of a trial solution. The results are tested and further values 


calculated according to the iteration scheme in the digital computer. 
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Output of the final solution is done on the typewriter of the teletype 
Unit. 
52cm Description! ofthe Digital Program 
Language and Speed 

The program is written in an assembler language for the 
PDP-8. The DEC language PAL-D forms the basis for the program, with 
a modification of their floating point language being used for the 
Petrnmen ct Ol Lt The low-level language is required by the nec- 
essity of rapid calculation and core manipulation. Some of the 
arguments for the use of low-level languages are presented in Bell 
and Grtfsint?! The explanation of the program will be concerned with 
bloOcksBOLBinstruckions,enoOtewith individualginstruct#ions, Antorder to 
Beachetiesinpostantk | pointseandtto maintaingcontinuity, )frou thesrest 
of this section, reference to Appendix 4 will be required, especially 
GOgGhewGlowachabre, EiguresgA-451. 
The Main Program 
START 

The input message is printed and the initialization execut- 
CdgconprepacemtOradataginputeroreainewrcase. eulhesinput pdataysettis 
typed by the operator as a string of numbers in floating point 
representation (decimal) and each number is stored. This is done by 
the READ loop using indirect addressing and address modification. 
The initial states are set on the appropriate digital to analog con- 
verter channels. 
ENTRY 


An analog computer run is made by the subroutine RUN. The 


value NX of | |p| | at the terminal time is calculated by subroutine SNX. 
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NX thus is the distance from the terminal state to the target set. 
If NX is less than EX, the specified state error tolerance, execu- 
tion continues at OUTPT, which will be described following this 
section. If not, the terminal error norm, ND, is calculated by 
subroutine SND. If ND is less than ER, the terminal error toler- 
anee, Execution -continuesmat INCOST.. If not, control is transferred 
to) the ireration tscheme composed¥of instructions at (SET! J SET2), SET3 
and SET4. 
OUTPT 

To expedite solution, a two-stage search has been program- 
med. ‘Ihe first time that OUTPT is reached, (INDEX=0), the tolerances 
and step sizes are decreased and the problem restarted from the 
eurrent value: of initial costate..) ihe second time OUIPD is entered, 
when the changed terminal error tolerance has been reached, the final 
values are printed out and control returned to START for entry of a 
new case from the keyboard. 
INCOST 

INCOST is entered when the terminal matching condition is 
Saurstied «eine costlis tincreasedsby DD tand control isi returned’to 
ENTRY for a new search for’ a costate vector. 
The Iteration Scheme -- SET1, SET2, SET3, and SET4. 

For this section to be reached, OUTPT and INCOST have not 
been entered. 

SET1 is entered in the first step of an iteration, when 
ENTRY was reached from START or INCOST, and NU is -l. The costate is 


called the reference costate, (Nl, N2) and the value of terminal error 
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norm ND is saved as DM, corresponding to (Nl, N2). NUis set at 0, 
Nl set to Nl + DE and control returned to ENTRY. 

Next, SET2 is entered. ND - DM is saved as DN1, corres- 
pondime sco (NI + DE N2)e NU is set. at 1, Nl reset to the reference 
value, N2 set to N2 + DE, and control returned to ENTRY. 

When SETS is entered, N2 is reset to the reference value, 
ND -DM is saved as DN2, corresponding to (Nl, N2 + DE), and NU is set 
at 2. The magnitude of the gradient of the terminal error norm is 


Z 128, 
tN 2 )?/DE and the steps in the negative 


calculated as M = (DNI 
gradient direction are calculated as (-DN1/M, -DN2/M). A new refer- 
ence weoOstate is calculated as (NI — DNI/M,; N2 = DN2/M). Control is 
Becurieds £oO ENTRY . 

The final step of the iteration scheme is a repetition step, 
atmollés tLe the value of DN is less than that previous (DM), DN is 
saved as DM and the correction precedure is repeated. The negative 
gradient steps are added to the reference costate forming a new refer- 
ence costate and control is returned to ENTRY. When the value of DN 
returned is not less than DM, this repetition ends. The negative 
gradient steps are subtracted from the reference costate to give the 
previous (and better) value, NU is set at -l to force the calculation 
of a new gradient, and control returned to ENTRY. 

Subroutines 
DACON 

This subroutine converts the octal number in the accumulator 

PieORAave Leaee on tne channel siven by DMACHN. “The values —3///., to 


8 


3777, (-2047 to 204744) are converted to voltages in the range 


10 
=O. volts, to 10 volts. 
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ADCON 


This subroutine converts a voltage on the channel in the 
accumulator into an octal number in the accumulator, using the same 
scale as indicated in DACON. 


RUN 


This subroutine operates the system once. The cost and 
initial costates are digital-to-analog converted and set onto the 
initial condition channels. The analog computer is put into operate 
mode, after a pause for charging of the initial condition capacitors. 
Analog-to-digital channel 0 is then tested until the run-end condi- 
tion has been met and the computer placed into the hold mode. The 
values of the terminal state and costate are then converted to 
digital values and stored. 

SNX 

This subroutine calculates the Euclidean norm of the vector 
De as NX. In the case programmed here, the target set is the line 
segment on the Xl axis with right and left boundaries, DL and IL, 
eespec ively. De Tsecalcudatedsas 

GE Ge) Nak Sa ane 
De =G- Xp = (0, -X2) dee ee DL (Seo) 
(Gab Ss Val eh) nL ge itt 
thesordeimal value of Xlsisesaved sas X1R, aid Xl is used for the 
first component of D,, in the remainder of the subroutine and in SND. 

The norm of De is calculated as NX = Oe + dD, 2 (0) 

SND 


2y/ 


This subroutine calculates the Euclidean norm of the terminal 
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costate vector. Then the terminal error norm is calculated as the 
value ND. This was given in (3.3) 
3.4 Extensions of the Program 
Higher Order Problems 

The program could be conveniently extended to higher 
order systems than second order ones. The input, operating and 
output subroutines would simply require additional steps to carry 
the extra values to and from the analog computer. The norm cal- 
culations would be modified only by the addition of additional 
Squared terms. A branch of the aeevure aril scheme would be added to 
correspond to SET1 and SET2, where the steps are taken in calculat- 
ing the gradient, in order to calculate each extra component of the 
gradient. The major forseeable difficulty is in the analog program, 
where it has been found that special and possibly digital computer 
controlled approaches are necessary as the order of the system in- 
creases to handle scaling problems with the costate aay to! 
Other Target Sets 

Extension to other target sets which are fixed is a simple 
matter of modifying the subroutine SNX to properly calculate the 
value of De This is possible for the target sets discussed in 
Secu lonmeza2), ewhnichiwhave va, finite number ‘ofeattracting megions, with 
difficulty directly dependent on the complexity of the target set. 

The time-varying case will have only the added complexity 
of predicting the final time in order to use the methods suggested 
imesection 2.3.) NX would be modified to, predict the final time, 


or to use the current time to calculate the ||D| | value. 
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CHAPTER 4 


APPLICATIONS 


In this chapter, as the title indicates, the technique 
developed in the earlier chapters is applied to a linear second 
order system and a nonlinear second order system. 
lee the Hasnon ie Ose7! Lator 

The undamped harmonic oscillator, extensively studied in 
the literature, was chosen as an example of a linear system. This 


system is described by the differential equation 


2 
: x w(t) = Ce 1 SO, a) fae (4. 


dt 


Using the set of normalized state variables 


2 

(Ce a x(t) 

0 we ° (45 
x, (t) ae sd Ge)) 


the state equation becomes 
0 i 0, 
x(t) = | x(t) + u(t) . (4. 
etal): —) Lay, 


Ge spLoblemsof stcansi tion yok ithe sstate.fromethe winitial «state x(t.) 


1) 


2) 


3) 


to a line segment on the xy axis in minimum time will be considered. 


Jaa ee | 
ZAGS UN ARS Ra a Pre ey) (4.4) 
x 
2 
oy a NNO SE se Glo t Ney y ith Eid (4.5) 
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x(t,) ag e G(x). (4.7) 


A detailed derivation of the exact solution to this problem 
ey 


is found in Athans and Falb inewHemnd eonwdan 


H(x, Uy Pp) ae ib oi ah pens iad PoX) he Pao (4-3) 


is minimized by 


u(t) = - sgn Py (t). (4.9) 
The costate equation is given by 
0 1 
. oH 
DE re p(t) (4.10) 
= ib 0 


The following points can easily be shown to be true. The 
solution of the costate equation is simply that of an undamped, un- 
controlled harmonic oscillator; the costate trajectories being circles 
about the origin. The time optimal control must be piecewise constant 
by (4.9). There can be an unlimited number of switchings, due to the 
harmonic nature of P(t). There is no possibility of singular control. 

ime thessolutionsusine) the oriecineas tue tarcet setymit can 
be shown that the extremal trajectories are circles about the point 
CAS 0) inestate space, with A = £1 being the control specified by (4.9). 
The time taken to move the state along one of these circular arcs is 
given by the angle at the centre of the circle subtended by the arc. 

An analytical method of finding the time optimal solution is thus 
available. The angle sum gives the time, while the time to the first 
switching gives the initial costate. 

The state and costate equations were programmed on the analog 
computer, with initial conditions supplied by the digital computer 
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program. Unity scaling was used (within the arbitrary factor of = so 
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FIGURE 4.1 TYPICAL HARMONIC OSCILLATOR SOLUTION 
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BY Be De COMPUTER SOLUTION 


Di Po COs tse STATE Ss <COSIATES 
PeROMEIERS:s “RI GHTs LERT TARGET POINTSs = COST & COSTATE STEPS 
ERROR NORMS: STATE & TERMINAL 
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FIGURE 4.2 INPUT AND OUTPUT FOR FIGURE 4.1 
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that the problem was limited by the +10 volt range of the analog 
computer. One volt was used as one unit for the solution. 

The solution of the optimal control problem was found for 
a Variety of cases. The results of some of these tests are even in 
Taple 4.1 «For the cases with the orlein as the target set, the exact 
solution is included. The time taken by the hybrid computer for 
solution, exclusive of teletype output, is included for some of the 
restos icure 4.1 shows a typical solution of the system. It is 
accompanied by its input and output, in Figure 4.2. The general 
characteristics of “these results are discussed later in this chapter. 
4.2 A Bilinear System 


ee 


A bilinear system considered by Moon and Mohler was used 
as the second example. This nonlinear system is bilinear in the sense 
that it is linear in states and controls when separately considered. 
However, this property is not of any significance in the present dis- 
cussion. 

The problem is that of moving a searchlight and stopping at 
a specified angle in minimum time. The searchlight dynamics are 
controlled by the driving motor, which is controlled by armature current 
and by a brake. The losses in the system are negligible. The torque 
GrethesDGemocor 15 proportional to the armature lcunrent. 


a) 


The state equation is (from Moon and Mohler 


X(t) 
“(t) = (edad) 
~a, (1 + uy (t) ) x, Ct) + au, (t) 
where x, (t) is the angular position in radians, x, (t) is the angular 


velocity in radians per second, u, (t) is the armature current. uy (t) is 


the braking control and ay and a, are appropriate positive constants. 
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TABU Baise: 
Minimum Time Solutions for the Second Order Harmonic Oscillator 
Parteass whe Warget.Set as) the Origin 
Experimental Results 
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TABLE 4.1 


Part B: The Target Set is a Line Segment on the x, ~axis 


Experimental Results 


tnitial Initial Target Final Number of Final Final 
State Costate Segment xy] Iterations Time Costate 

Guess Value (Secn) Ratio 
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Eee SS thy SZ Mas if , (4.12) 
(0) 


ihe initialWwestate is elven as x and the final state is 


; T 
required to be (0, 0) in the original problem. The Hamiltonian is 


MGS We py) 1 Se eae P,(ay(1 + u,)x, + aju,) (4313) 
and the costate is given by the equation 
0) 
qu (4.14) 


“Pp, (t) i a, (1 a Uy) Py (t) 


Minimization of the Hamiltonian with respect to the control 


yields the control functions 


oe eecen a1P,(t) = S50 P, (t) 


(4215) 
u, (t) = sgn A5Po (t)x, (t) = sgn p,(t)x, (t) 
The problem was solved using the following values: 
e - Bers tes CON). OS SAGE 
tS 0; ay 2S ay = al xy =I) Xo = 10. (4.16) 


The state and costate equations were programmed on the analog 
computer, alone With the control functions. The initial conditions 
were supplied by the digital computer program. Unity scaling was used, 


(0) 
2 


thus x was set as close to full scale as possible, 9.997 volts, 
Cne Dit short of 10° volts: 

The case described was studied in depth, since the problem 
was almost full scale, and since comparison with the results of Moon 
and Mohler was possible. Cases using target sets other than the origin 
did not add any additional information to the study. 

The results of some of the tests are recorded in Table 4.2. 

A typical solution is shown in Figure 4.3, with its input and output 


ie coure 4a nesseneral Ghapactenisti¢erct these results are dis- 


cussed in the following section. 
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HYSRID COMPUTER SOLUTION 
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Peover os een ti Gils LEM TSIAKGED POINTS» @ COSI =o) COSTATE SlEPs 
ERRCR NORMS: STATE & TERMINAL ‘ 


GT TSIM SPORT TE ae aT 4 TCA AGH GN C37 Ges +e «15 


FINAL: STATES —+ 2146 AND + “Q09T7 
COSTATES - 1-341 AND - 6* 34966 
COs lees 4.9399 CSECONDS)- 

+ 615 ITERATIONS. , 


FIGURE 4.4. INPUT AND OUTPUT FOR FIGURE 4.3 
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TABLE 4.2 


Minimum Time solutions for a Second Order Bilinear System 


Experimental Results 


muctial Unhita ) Target Number of Final Final 
State Costate Segment Iterations Time Costate 

Guess (Seow) Ratio 
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4.3 Discussion of Results 

The main objective of this research has been more to examine 
the effectiveness and validity of the technique developed rather than 
to compile solutions for a large number of examples. Consequently, 
only a few of the large number of cases treated were studied in depth. 
The general conclusions, however, are based upon the results of these 
detailed studies and upon the information gained by trying the other 
cases. 

LEmisewellaknownSthatethe costate equation must be linear in 
the costate, so that the costate can be found only to within a scale 
factor with its sign determined. For this reason, the ratio of costates 
is reported here. In order to consider values in the full dynamic range 
of the costate to ensure that the more influential component was used 
half the time, both the costates were varied. This also tested itera- 
tion techniques for handling two simultaneous searches for future 
applications. 

The tests on the harmonic oscillator showed that a rapid 
solution was indeed possible using the program developed to implement 
the technique. The solution times were in the order of ten seconds. 

The study of this system indicated the severity of step size effects. 
The use of large steps was found to result in fewer iterations until 

the target set was approached closely. Then the method would usually 
fail to converge, since the terminal states had become highly sensitive 
to initial costate changes and large steps were being used. On the 
other hand, small step sizes usually guaranteed convergence, but usually 
wen a large mumbéer of iteratilons ~lhese effects suggested the imple- 


mentation of two stages of search, the first one with large steps until 
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the target set was approached closely, and the second one with smaller 
steps until the solution had converged sufficiently. This strategy 
was adopted, using the arbitrary factors of five for the cost and co- 
State steps, ~and terminal condition errorrtolerance,, and ten for ‘the 
terminal error. In general, it was evident that step size choice was 
a compromise between speed of solution and risk of failure to converge. 

The cases tested showed a lack of close repeatability. There 
were three factors in this. The solution accuracy in 'fast-time" | 
Speret rom sephobaplyscloser to 7 ethangto ol 7.8) Inis) meant that the 
terminal values fluctuated from run to run. The discrete steps of the 
analog data after conversion to digital data was in effect quantization 
into steps which grew in proportion as the value became smaller. Con- 
Sider a quantity which approaches zero. The number of bits represent- 
ine it decreases, until each bit is a large part of the quantity. An 
analog voltage less than .01 volts in magnitude can be only one of five 
Petes: ea iO een (Octal wml iemtni rdarasctotm was. themabrectmur 
rounding the computed costate changes for digital to analog conversion. 
This caused steps in the initial costates rather than continuous changes. 

One factor which appeared to enter into the cases studied in 
depthiwas the switching error. The’ (1, me case had only one switching, 
whereas three switchings occured in the (4, Lye case. The finite speed 
of the comparator used for switching (7us) probably contributed to the 
greater mean error in the costate ratio for the latter case. 

The bilinear system showed a major difficulty in application 
to some problems. The progress of the search was arrested for a large 


number of iterations while an abrupt change in the initial costate was 
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made. This brought into question the assumption of Miura et ai 


namely that the initial costate changes continuously with increasing 
cost. It became obvious that this assumption failed whenever the 
mode of solution being followed eventually led away from the target 
set, at which time a new mode for the control strategy had to be 
found. The program was able to find the new mode but the technique 
was not designed for jumps in the initial costate and thus did not 
handle them See 

A wide range of solution times (not tabulated) was observed 
dueetCetienjunp in the initial costate, from 25 to 100)seconds. In 
the cases examined, a large number of iterations occured, occupying 
a substantial portion of the solution time, while the initial costate 
was changed to allow continuation. This is noted in Figure 4.3. 

Although difficult to compare directly, Moon and Mohler's 
results were available for comparison. They reported that the system 
was solved using their method with an IBM 360/75J at the University 
of California at Los Angeles in approximately 4.05 seconds per run, 


; 
using less than 64K bytes (with 32 bits per nus ene 


The PDP-8 
used just over 1K bytes, with a little help from the TR-48 analog 


computer. It is probably safe to consider the cost of using the 


a2 


360/75J as somewhat more than ten times that of the PDP-8-TR-48 hybrid, 


while the solution time was no more than ten times better. 
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CHAPTER 5 


COMMENTS AND CONCLUSIONS 


5.1 Improvements in the Program 

The conclusions reached in this thesis are based somewhat on 
the experimental work, and are thus influenced by its imperfection. 
The possible improvements in the program are discussed here in order 
to moderate some of the adverse affects of the particular implementa- 
tion of the technique. 

The most important problem which depended on the program was 
concerned with the search strategy. With the "a posteriori” knowledge 
that jumps in the initial costate are possible, the program could em- 
ploy a strategy which used very large steps at the appropriate time to 
find a new mode of extremal control. During normal searching on the 
terminal error condition, the steps used could be variable depending 
on the current success or failure of the gradient search, according to 
the planned strategy. It would be desirable to increase the step size 
whenever the convergence appears satisfactory and to decrease the step 
size if the steepest descent iterations are not succeeding and at the 
final stages of meeting the terminal error and target conditions. 

The total execution time could be reduced by about twenty- 
five per cent by the use of machine language programming exclusively 
in the solution iterations. Since all values communicated can be only 
one word long, no significant use of the Floating Point System was made 


in the calculations. One word arithmetic, possibly with provision for 
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some round-off controls could just as well have been used. The program- 
ming effort would be increased, however. 
5.2 Summary 


[10] 


Thertechnique init@ated by Miura, Tsuda‘ ‘and Iwata for the 
solution of optimal control problems on the hybrid computer has been 
examined and extended in this thesis. The algorithm for more general 
target sets was derived and shown to work on a second order system. 

It was shown that the assumption, made in Miura et Ail Ta 
that’ the extremal solution which is ainitially ‘closest to the target set 
is the optimal one, does not always hold. A counter-example was described 
in Chapter 2 to support this statement. In addition, it was shown exper- 
imentally that the assumption that changes in initial costate are contin- 
uous with increasing cost is invalid, and it was to be expected that 
shifts or jumps in the initial costate would occur as cost increased. 

This was caused by the need for new modes of control which were not in- 
itially minimal-distance ones. 

The hybrid computer program was shown to be usable on some 
examples, even when the unexpected shift in the initial costate appeared. 
The efficiency of the program could be improved for regular use of the 
program. The use of "fast-time" integration was necessary to make solu- 
tion times reasonable. The comparison between the solution from Moon 


and Mohler !111 


and=tnatein this’ thesis ls °difiricult™ to make, but the 
product of capital cost and solution time for the hybrid computer is 
probably smaller than for the IBM 360/75J. Satisfactory solution of 


these systems on a PDP-8 alone would be slow or impossible because of 


the small memory available. 
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5.3 Suggestions for Future Work 

The technique developed here could be used in the solution 
of optimal control of deterministic systems modelled on the analog 
computer. The validity of the algorithm for a particular system 
would have to be established because the algorithm is not always 
applicable. The convergence to an extremal solution could be guaranteed 
by improvements in the program to handle shifts in the initial costate. 

The limitations of this technique seem to indicate that more 
work should be done in order to establish sufficient conditions for the 
solution of given classes of problems. Using the method on more complex 
systems without establishing its validity might prove futile. The 
application to time-varying target sets should be made. In the case of 
systems for which the assumptions made in this thesis are valid, the 
application of some other techniques, which do not use the costate and 
the minimum principle, such as perturbation techniques, should be examined. 

Since it has been found that the technique works for the second 
order harmonic oscillator, the relationship between the ideal (undamped) 
case and non-ideal cases (e.g., positive and negative damping) could be 
examined. 

The on-line control of a simple real system might be attempted 
by simulating the system on the hybrid computer, using the model to 
determine the optimal control strategy and then using the hybrid computer 
to apply the strategy to the real Rowe 

It is proposed to submit the significant results in this 


thesis for publication in the IEEE Transactions on Computers. 
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APPENDIX 1 


Some Definitions and Results in Optimal Control Taree 


1. A Dynamical System 

A dynamical system S is the composite concept consisting 
Ofesets ie). (jnand Usa variable x(t), and a PnetLon se such that 
the axioms Pistéedgare satisfied. T,"alsubset of the real numbers, 
is called the domain of the system, 2 is the (metric) state space 
of the system. U, the input space of the system is a set of piece- 
wise continuous functions on T with values in the (metric) space 2. 
oG 2) tSseene state Vyariaplesandeisederined on [ewith) values in) 2. 

(to >t] is a half-open interval in T and used as an argument denotes 
a segment of a function on T restricted to (to tl. g is-a function 
Loon x eee | into ie u(t. t] is a segment of u(t) in U, called 
the input over the observation interval to the system. 

SAG Fea = glx(t.) u(t ,t]] is a corresponding output of the system, 
with (u(t, >t], y(t) tl) forming an input-output pair of the system. 
CG) a= oftsuCt.,t], x(t.) ] describes the trajectory of the system on 
(to>tl, starting from x(t.) and generated by input u(t,,t]. 

It is assumed that the state at tj» x(t,); and the control 
u(to >t] specify a uniquely defined output. The system is nonanticipa- 
tive since future values of the input do not affect y(t. ,tl. 

It is assumed that every input-output pair has a correspond- 
ing state history x(t) ,t] hey en 

It is assumed that g and $ are smooth in their arguments so 


that small changes in the input cause small changes in the output and 
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trajectory of the system. 

it iseassumed) thatthe transition function ¢ satisfies the 
transition, or semigroup, condition in that the initial condition 
eornesponds tO Che Sstartine point of the trayectery; and 1: the dn- 


put takes the system from XS LOstealOne a trajectory, and tie x 1902 


state on the trajectory, then the input will take the state from 


2. Finite Dimensional 

A dynamical system S is finite dimensional if the state 
Space is a Euclidean space, = = tes and 2 is a Euclidean space, 
Q = fe. with m <n. n is the dimension of the system. 
3. Continuous-Time 

A dynamical system S is continuous-time if T is A open 
interval of the real numbers. 
4. Differential 

A dynamical system S is a differential system if the state 
is given by a solution of a differential equation system 
Re) = NOs ete vies) x(t.) as initial condition and g is a continuous 


function of its arguments. 
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APPENDIX 2 


Some Aspects of Hybrid Computation 

Hybrid computation is discussed from the viewpoint of op- 
timal automatic control studies with the plant simulated in the 
analog computer. This restricts the scope of this appendix, which 
Esymot itended as a tutorial acceunt for the uninitiated, to the 
area OF COMeern Of this) thesis. The object 1s to summarize some of 
Ene aspects Of hybrid computation examined by the author and to indicate 
some generalizations which have been made. 

Bekey and Karplus define a spectrum of hybrid computing 
techniques and systems, ranging from pure analog computers with 
digital logic to pure digital computers with analog inputs. They 
state, 'The most extensive and powerful of existing hybrid computer 
systems are comprised of general-purpose digital computers and gen- 


ol Su 


eral-purpose analog computers. Bell and Griffin concur, terming 


this type of system “the most flexible hybrid computing ae 
Specifically, such a hybrid computer consists of the analog 
and digital computers mentioned, with a communication link between 
them. The function of the communication link is to transfer analog, 
digital and logical signals between the computers, making the appropri- 
ate conversions. It is this type of hybrid computer which is implied 
in this appendix. 
A-2.1 Inter-Computer Communication 
In a hybrid computer system the communication link often be- 


comes the "weak link" in the chain. The number of channels of analog- 


to-digital and digital-to-analog conversion (hereinafter termed ADC and 
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DAC, respectively) which are available determine the amount of informa- 
tion which can be transferred between computers. The speed of multi- 
plexing determines the rate of transfer (with fast languages). ‘The 
availability of extra logic signal channels can simplify many facets 
of computation without tying up an information channel. Mode control 
@@e=the analoescomputer falls into this category. 

The time taken by the communication link to perform the 
operations required may introduce a variable and significant time lag 
into some computations. This time lag is directly proportional to the 
slowness of the digital computer language used. For instance, the 
applications in which the digital computer is used for calculations 
of nonlinearities for the analog computer solution are seriously 
affected, especially in “fast-time" operation of the analog computer. 

The effect of the communication link in speed of operation 
eanmbem lessenecdlpyacvolding atspusepinescriticallystimed: operations. 
An analog comparator switching in 7 us is obviously better than an ADC, 
amtest sor the waluespandpac DAG) consuming abouts /0 se when using) the 
switching within the analog computation. In the same category of 
operation is the use of an incremental conversion ADC fed directly 
into the accumulator of the digital computer and tested as often as 
possible. This technique would require about 7 us in the PDP—8-TR-48 
system, but possibly less in a digital computer with half the cycle 
EIMeGNOLUL. 5 MepotetheseDP-8. Binwanyrevent, iteise clean thats using 
the digital computer in ongoing analog calculation requires study of 
the effects of computation times, both fixed and variable. There are 


several applications, however, in which the digital computer results 
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are used only when the analog computer is in hold mode. This is the 
technique used in this thesis. 

Communication is also affected by the discretization of con- 
tinuous analog data by the ADC. This is further discussed in the fol- 
lowing section of this appendix. 

Does ee ACCULACY 

Accuracy requirements in hybrid computation are determined 
by a somewhat different set of conditions than those affecting digital 
computation. In particular, the solution of a set of differential 
equations programmed on an analog computer will converge to a real 
solution (of the system programmed); whereas one has no guarantee 
that a given method and step size will converge to a solution in a 
digital computer solution of the same set. The precision used in 
digital computation is made necessary to some extent by the methods 
chosen for rapid solution, at the price of guarantees of convergence. 

In simulations of many physical systems, accuracy in the 
order of one per cent is completely acceptable. The non-exact nature 
of the differential equations, parameters, input signals and outputs 
precludes the use of six to sixteen significant figures which are 
often necessary in the solution of the system on a digital computer. 
inewlimit Of accuracy ©£OY analco2 computers is .0172,.but the high speed 
transistor amplifier models are limited to .1%. In high speed opera- 
tion this may arene 1% as switching times and capacitive effects 
become more significant. 

Since the costate equations are unstable for stable state 
equations systems, the magnitude of the initial condition of the co- 


state must in general be sufficiently small to prevent the costate 
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system from reaching the limits of the analog computer amplifiers; 
yet it must be as large as possible to cope with discretization prob- 
lems. 

The discretization of the communicated data has an import- 
Bitectrect here. JA I2 pat word implies a step size of,.0497% of the 
analog computer fuliescales(lLOivelts for most transistonasystems)., 

For a costate value which increases with a dynamic range of 100 over 
the solution time, this would make each step 57 of full seale, a 
Sieuificant diseretization error. 

The analog computer, DAC and ADC must be calibrated properly 
to ensure maximum accuracy. The nature of the applications considered 
in this thesis are such that drift of the analog component character- 
istics does not have a significant effect, since run times are very 
Shore. wand initial conditions pare reset etnom the DAG soricach .run. 
Along with calibration, loading effects must be considered since fast, 
large bandwidth amplifiers are used. The comparator output may be 
susceptible to loading error, for example. 

The accuracy of calculations an the dieital computer must 
be considered, but in applications such as found in this thesis, the 
calculation requirements are few and are more or less independent of 
previous runs. This precludes the buildup of round-off and numerical 
PS apwe bby eer LOLs. 
b> ppeed 

A fundamental consideration is speed of solution. The speed 
of solution of a hybrid computer method must be of the same order as 
a good digital computer method to be competitive. This requires the 


use of the fastest possible techniques in both the analog and digital 
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portions of the hybrid system. 

Most modern analog computers are constructed with two normal 
speeds of integration. The "slow-time' mode uses integrators of unity 
gain as the basic unit. The "fast-time" mode uses a gain of 500 or 
1000. Normal usage of this mode is in repetitive operation with 
initial condition and operate modes cycled from 10 to 1000 (or more) 
times per second. If the mode control is accessible, the digital 
computer can control the analog computer, replacing the timing unit, 
ompindavidual lyecontrolling sets of integrators. For studies such as 
found in this thesis, the high speed mode must be used whenever 
possible to decrease run time. 

One important consideration when the digital computer is used 
to control the analog runs is that enough time must be allowed for the 
imitial Cenembton Capacitors sto be pcnarced to the specified levels. 
lomsete inatral’ conditions itowwithin .05,.08 full (scale requires ,/..6 
time constants of the charging network. The finite switching speed of 
the comparators and the mode controls must also be taken into account. 
In many computers, the hold mode is switched by relays, which may 
necessitate the use of track-and-hold amplifiers to stop critical 
values at the instant desired, faster than the computer can be switched 
into hold mode. 

The communication link is likely to constrain the speed of 
‘solution in applications in which conversions form a large part of the 
calculation. Some systems are set up with relay multiplexing, which 
is almost useless at high speed operation. Solid state multiplexing 


and low settling time are important in this type of calculation. 
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The digital computer speed begins to become significant 
when high speed analog computation is used. One will often have the 
choice of different levels and types of languages. These are sum- 
marized here, specifically with reference to the PDP-8. An import- 
ant consideration is execution time, since the program will be repeat- 
ed many times for one solution. 

The slowest languages are the interpretive ones, such as 
FOCAL from DEC. The operating system interprets each command and 
each variable when encountered in execution, performs the command 
using any subroutines necessary, and then reads and interprets the 
next instruction. In FOCAL, 10 ms is the minimum amount of time re- 
quired to read a command and execute it. ADC and DAC take about 40 ms. 
Obviously, such a language is too slow for rapid solutions. 

Compiler languages are much faster in execution. A language 
such as FORTRAN has a compiler which changes the instructions into 
machine language commands, stores variables, checks for errors and 
“produces an “object program" which is the actual set of machine lang- 
uage commands. Tih languages are usually somewhat inefficient in 
that the compiler is not able to use the techniques a human programmer 
might use, and in that every program must have allowances made for 
situations which may be encountered in different types of programs. In 
the two types just mentioned, programming effort is lowest. Imstruc~ 
tions can be efficiently written, with the task of sorting out the 
machine language sequences necessary to execute them left to the com- 
Daslec. 

A low level language which is a compromise between the higher 


level languages so far mentioned and the very low level languages to be 
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mentioned is illustrated by DEC's Floating Point Byeten thas lang- 
uage contains instructions analogous to assembly language instructions, 
which are assembled in the same manner. They allow the programmer to 
program floating point operations on numbers consisting of three words, 
one for the power of 2 and two for the fraction between .5 and 1.0. 


3 


Thus 5).0m8S stored as 0003 2400 0000 or 625, 2” 5 Som saciiiclamaiesle 


8’ o 
Operations and functions are available and input and output routines 
are used, as supplied or added by the author. The PAL-D eeennler ee 
is used to assemble the symbolic instructions into machine language 
code, with most of the organization of the program already done by the 
programmer. Further discussion is contained in the third appendix. 
The lowest level of programming language is represented by 
DEC's PAL-D Assembler in its basic form. At this level each machine 
language instruction ji represented by a symbolic code. Variables are 
addressed as names, and addressing and assignment of space is usually 
the concern of the programmer. Some automatic assignment of addresses 
is possible. The programmer, through the exertion of a substantial 
amount of programming effort, may be able to develop a very efficient 
program as far as execution time is concerned. The programming effort 
required, once basic skills at assembly language programming are 
acquired, may be justified by the efficiency, but a compiler language 
should be available for many applications and especially for prototype 
Drogcams. | Lhe Floating Point System must be considered to be an ass-— 
embly language in this respect, differing from the simple assembly 


languages only in the availability of a number of subroutines for use- 


ful operations. 
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The discussion of computer languages has been oriented to 
the PDP-8, which was used by the author. Other small computers with - 
4K or 8K of core also have the same type of possibilities and most 
of the preceding discussion will apply. 

One further=point is -ofsimportance. = ‘The output ‘from the 
hybrid computer should be considered as a factor in the utility of 
applications. High speed solutions may be displayed on a storage 
oscilloscope, with photographs providing the "hard" copy which may be 
desired. The monitoring of the solution with the oscilloscope allows 
operator intervention in the case of unforeseen problems. Should the 
hybrid computer be used in an application where numerical values are 
required, then the (very) slow teletype or electric typewriter output 
should be used. In applications such as those in this thesis, the 
amount of time for printing out the few results is of the same order 
of magnitude as the solution time. Clearly, in a situation where the 
hybrid computer is used to solve a control strategy problem for a 
real-time system, the result should be immediately applied to the 
system, after which the pertinent permanent record should be made, 


possibly on a shared time basis with the real-time control program. 
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APPENDIX 3 


Description of the Hybrid Computer 

The hybrid computer used for this work is located in the 
Department of Electrical Engineering at the iienovers hey of Alberta. 

It consists of one TR-48 solid-state analog computer, an interface, 
and one PDP-8 solid-state digital computer. The computer is operated 
in an "open-shop" manner. 

The TR-48 is a medium capacity general-purpose analog 
computer, manufactured by Electronics Associated, Incorporated, West 
Long Branch, N.J. Its range is from -10 to + 10 volts with chopper- 
Stabilized transistor operational amplifiers. The computing components 
conststeoL the following:) 18 integrators, 36 summers, 5 electronic bi- 
polar multipliers, 4 electronic comparators, 8 electronic switches, 

60 pots, 8 servo-set pots, 8 feedback limiters and 2 twenty-segment 
diode function generators. 

The mode of each pair of integrators can be controlled individ- 
ually. Mode control is effected by electronic switching between operate 
mode and initial condition mode and by relay switching between these 
modes and hold mode. In repetitive operation mode, the mode control 
logic signals are cycled between operate and initial condition, with 
ten milliseconds initial condition mode and from ten to five hundred 
milliseconds for operate mode. This particular cycle can be replaced 
by any other scheme desired using the digital computer 258 POnELOLe weet 
is this type of operation which is referred to an "fast-time", since in 
Pree ri etmerstion (whether or not internally cycled) the speed of 


the integrators is increased by five hundred. '"Fast-time'' operation 
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allows the high speed solution of differential equations, and makes 
the iterative solution of ordinary differential equations practical. 

The interface or communication link is based on Redcor 
Series 610 Linkage System. 

Twelve digital bits are converted to +10 volts of analog 
information by one of sixteen digital to analog converters. An analog 
voltage from one of twenty-four channels converted to thirteen bits 
(twelve being used) by the analog to digital converter by means of a 
solid-state multiplexer. 

The remainder of the interface consists of logical and timing 
facilities designed and implemented in the Department of Electrical 
Engineering. The only one of concern here is the analog mode control 
facility, which translates the command from the digital computer into 
the appropriate logical values to bring the appropriate mode. 

The PDP-8 is a small general-purpose digital computer manu- 
factured by Digital Equipment Corporation, Maynard, Mass. It has 
4K (4096) twelve bit words of core memory, operating with a cycle time 
of 1.5 us, two TU-55 Dectape magnetic tape units and a 32K disc memory. 
It has a full complement of hardware machine language instructions and 
ean service sixty-four peripheral devices requiring three commands each. 
The paeloe mode er ene commands, and the commands used in ADC and DAC 
are examples of these. The PDP-8 has the extended arithmetic option, 
which improves arithmetic calculation speed by the use of hard wired 
instruction. An ASR~-33 teletype provides teletype input and typewriter 
output to the computer by means of appropriate programs. 

As important as the hybrid computer hardware is, the software 


must be flexible in order to make use of it. The PDP-8 is supplied with 


wa _ rr 
cesta fie emhtog~s Tejsrgadiise to avai higge Mal 


2 36 H.fo bs 5 | af afl nme eo The } is 
’ : j2¥ 
i : 7 5 
‘ 
lim 3 eitoay, 03 od bs3eSehoo at S47 bea 
; 740 I oi fs ; : i 
2 
d nesgtidy of UWsetev ion elecause we ined. 10 Ste mez 
Y ok z . e 
enka Veo Ysa yovnvo r] . Fons ont vd Cheesehead 
: its sie! sia 
a 
r } 1 ySholg att 
: 
, 
a f i f Bf . } 
- y ~s 
7 i i o4BF 
fs 7 , SIS »& 
: 
nq c rT " [ 7! 1 
; ' : { ght 
; 7 : -i on 


ae fh 


— _ - - - a 7 e 
= 7 } "ey 2 Me" 
: : ; - > — a i; 


> i. 


- » - 
7707 [inl # gad a2 
_ 
a 


oe 
j 
E ; 
‘ 
{ 
I 
q t = 
i : =f J 
e * 
3 i » wt Sif 5 ' ’ } a 
> ‘ 
6 < 4 7 
ii 2 Mi att «Jb -1O ser savy of 
a a 
- 
_ 


a wide range of software from assembly to compiler to interpretive 
languages. In this thesis the PAL-D Assembly Peace re is used 
to assemble the machine language sections of the program. The reader 
is also referred to Introduction to Programming; Digital Equipment 


Corporation's general manual on programming the PDP-8 family of 


computers. 
The, Floating Point Brereria has a number of features which 
made it convenient to use. The program, as supplied by DEC, allows 
Operations to be performed on three-word floating point numbers. 
The first word is the power of two and the other two form a twenty- 
four bit mantissa between one half and one in magnitude when normal- 
ized. Input and output routines are provided for the teletype. 
Allowance is made for the addition of subroutines which operate on the 
floating accumulator (FAC)... The operations used in this thesis.:are 
the following: 
FADD A (FSUB A) - Add (subtract) the number A to the FAC, 
normalize and leave in the FAC. 
FMPY A, (FDIV A) - Multiply (divide) the FAC by the number 
A, normalize and leave in the FAC. 
FGET A - Load the number A into the FAC. 
FPUT A - Store the FAC into the three words starting at A. 
FNOR A - Normalize the mantissa of the FAC to magnitude 
between .5 and 1.9. 
These are supplemented by the following subroutine-type 
commands: 


FEXT - Leave floating interpreter. Instructions following 


are in machine language. 
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SQUARE - Square the FAC. 

SQROOT - Take square toot of the FAC. 

FIX - Convert the FAC into a one-word number at location 45. 

INPUT - Read a decimal number from the teletype. 

OUTPUT - Print the contents of the FAC on the teletype as 

a decimal number. 

CRLF - Print a carriage-return and line-feed. 

NEWOUT - Execute OUTPUT, then CRLF. 

RNDFIX - Convert the floating accumulator contents into the 

néarest one word number at location 45. 

Three additional subroutines are used in the program. The 
subroutine called by FLOAT will transform the contents of the real 
accumulator into a normalized floating point number. The subroutine 
called by MSSGE will print, on the teletype, the text stored between 
the first address, immediately following, and the last address, whose 
negative follows the first address. The message is stored two literal 
characters to a word by the TEXT pseudo-operator of PAL-D. The 
character (\) is used to execute the instruction CRLF as the message 
is printed. The other subroutine used is called by IN, and is the 
enenyeintortne tloabing poink interpreter. ALI ainstructions following 
are interpreted as floating point ones, until the command FEXT is 
encountered. 

The speed of execution of the floating point system lies 
between machine language programming and interpreter language program- 
ming. The interpretation of commands is what makes the difference. 


The arithmetic commands (FADD, FSUB, FMPY, FDIV) take from 330 to 385 us 
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to execute. In the interpreter language FOCAL, the equivalent commands 
take 20 to 40 ms. To set one variable equal to another (FGET A; FPUT B) 
takes (270 jis.) In FOCAL ‘this’ would take about 20 ms. In this program, 
van ADC takes 69 wis, and a DAC 44 us. Using the FOCAL functions takes 
about 40 ms. The use of the machine language and floating point 
programming increases the speed of digital operations by a factor of 
about 500. The net effect of high-speed operation is a speed increase 

of 500 times. Use of only one of the techniques (i.e. using normal 

speed integration or FOCAL programming) would have resulted in only 


two to five times the speed of normal operation. 
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APPENDIX 4 


SYMEOLS AND 
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FADD=16@@ 
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